Printer system and image processing system having image correcting function

ABSTRACT

A setting for white balance used by a camera during image-capturing can be reflected in a printer, thereby preventing, during printing, execution of such correction as negates an atmosphere of a light source in a recorded image in which the atmosphere has been intentionally allowed to remain. A camera used for a system of the present invention is a digital camera having a white balance process function of allowing the atmosphere of a photographing light source to remain in an image. During image-capturing, WB adaptation rate information indicative of a level of white balance correction is recorded on a recording medium as additional information. A printer reads the WB adaptation rate information for the camera via the recording medium to control white balance in accordance with the setting for the WB adaptation rate. For example, if the WB adaptation rate is less than 100%, then an AWB process executed by the printer is turned off to print the recorded image without changing its tints.

This is a divisional of application Ser. No. 10/117,224 filed Apr. 8,2002 now U.S. Pat. No. 7,304,668. The entire disclosure is herebyincorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a white balance control technique for asystem composed of an electronic camera and a printer. Further, thepresent invention relates to an image pickup device, an image processingdevice, an image processing system, an image processing method, and animage processing program. In particular, the present invention relatesto an image pickup device which outputs an image and information oncorrection of the image in association with each other to controlcorrection of the image executed by an external image processing device,and an image processing device which corrects an image on the basis ofinformation on correction of an image.

2. Description of the Related Art

In automatic white balance (AWB) executed by an electronic camera, thetype of a light source is determined on the basis of information from anexternal white balance (WB) sensor, which determines color temperature,or a CCD image sensor, so as to execute white balance adjustmentsuitable for the determined light source (Japanese Patent ApplicationPublication No. 2000-224608). The basis of AWB is that a gray object isphotographed as a gray image under a photographing light source.However, some types of electronic cameras provide such control that AWBcorrection is weakened depending on the determined type of the lightsource in order to allow the atmosphere of the light source in thatscene to remain in the image. For example, if an image is captured undera tungsten light source, then to allow the impression of the scene toremain in the image, slightly weakened white balance is executed toallow the gray part of the image to remain reddish.

On the other hand, when an image captured by an electronic camera isprinted, a printer also executes an AWB process. The AWB processexecuted by the printer is often set in order to correct an image withan AWB error committed by the electronic camera during image-capturing.

However, if a print is created using a combination of the “electroniccamera having the AWB function of allowing the atmosphere of a lightsource to remain in an image” and the “printer executing the AWBprocess” as described above, then the following disadvantage results: animage signal obtained as a result of image pickup executed by theelectronic camera does not undergo such a WB process as allows theatmosphere of the light source in that scene to remain in the image, butthe printer determines that this image has a WB error and creates aprint in which the atmosphere of the light source is negated.

Conventionally, common digital cameras have a function of correctingchromaticity or brightness of a captured image on the basis of apre-shipment setting or a user's setting. Further, the digital cameradisplays a captured image on an LCD monitor thereof. Then, a user canmanually adjust the chromaticity or brightness of the image whileviewing the image displayed on the LCD monitor. Further, imageprocessing devices such as monitors or printers are utilized whichautomatically correct the chromaticity or brightness of an imageobtained from a digital camera on the basis of a pre-shipment setting ora user's setting.

However, even if the user manually adjusts the chromaticity orbrightness of the image while viewing the image displayed on the LCDmonitor of the digital camera, the image processing device such as amonitor or a printer or the like may automatically correct the imagecontrary to the user's intention and output the corrected image.

SUMMARY OF THE INVENTION

The present invention is achieved in view of these points, and it is anobject of the present invention to provide a printer system that allowsa setting for white balance intended by a camera user to be reflected ona printer and which can prevent a print with the atmosphere of a lightsource negated, a white balance control method for this printer system,and an electronic camera and a printer both used for this system.

It is another object of the present invention to provide an image pickupdevice, and image processing device, an image processing system, animage processing method, and an image processing program that can solveabove-described problems.

To attain this object, a first aspect of the present invention providesa printer system that uses a printer to print an image captured by anelectronic camera, characterized in that the electronic camera comprisesa white balance correcting device which corrects white balance of animage signal obtained using an image pickup device, so that atmosphereof a photographing light source remains in the signal, and a recordingdevice which records data on white balance adaptation rate on arecording medium as additional image information together with acaptured image, the white balance adaptation rate being indicative ofthe level of white balance correction executed by the white balancecorrecting device, and the printer comprises an information obtainingdevice which takes the image and additional information thereforrecorded on the recording medium, and a white balance control devicewhich controls a white balance process executed by the printer using thewhite balance adaptation rate information contained in the additionalinformation taken through the information obtaining device.

The electronic camera used for the system of the present invention hasthe white balance processing function of allowing the atmosphere of aphotographing light source to remain in the image so that duringimage-capturing, the adaptation rate information indicative of the levelof white balance correction is recorded on the recording medium asadditional information for the captured image. The adaptation rate forthe camera may be automatically determined using the automatic whitebalance function of the camera or may be manually arbitrarily set by theuser by operating a predetermined operating device.

The printer reads the adaptation rate information from the camera viathe information obtaining device to control the white balance process inaccordance with this information. In this manner, the printer executesthe white balance control in accordance with the setting for the whitebalance adaptation rate for the electronic camera, thereby enablingcreation of a print with the atmosphere of the light source negated.

A second aspect of the present invention provides a white balancecontrol method applied to the above system. That is, this aspectprovides a white balance control method applied to a printer system thatuses a printer to print an image captured by an electronic camera,characterized by comprising the steps of executing a white balancecorrecting process when the image is captured by the electronic camera,so that atmosphere of a photographing light source remains in the image,recording data on white balance adaptation rate on a recording medium asadditional image information together with a captured image, the whitebalance adaptation rate being indicative of the level of white balancecorrection executed by the white balance correcting process, taking theimage and additional information therefor recorded on the recordingmedium, in the printer, and controlling the white balance processexecuted by the printer by using the white balance adaptation rateinformation contained in the additional information taken by theprinter, to execute printing on the basis of white balance reflectingthe white balance adaptation rate set using the electronic camera.

A third aspect of the present invention is an electronic camera used forthe above system. The electronic camera according to the presentinvention is characterized by comprising an image pickup device whichconverts an optical image of an object into an electric signal, a whitebalance correcting device which executes a white balance correctingprocess on an image signal obtained via the image pickup device, so thatatmosphere of a photographing light source remains in the image signal,and a recording device which records data on white balance adaptationrate on a recording medium as additional image information together witha captured image, the white balance adaptation rate being indicative ofthe level of white balance correction executed by the white balancecorrecting device.

A printer according to a fourth aspect of the present invention is usedfor the above-described system and characterized by comprising aninformation obtaining device which takes an image captured by anelectronic camera and information on white balance adaptation rateindicative of the level of white balance correction for the image, awhite balance control device which controls a white balance processduring printing using the white balance adaptation rate informationtaken from the information obtaining device, and a print device whichexecutes, in accordance with white balance control executed by the whitebalance control device, printing based on white balance reflecting thewhite balance adaptation rate set using the electronic camera.

As an aspect of white balance control executed by the printer inaccordance with the setting for the white balance adaptation rate forthe electronic camera, when in the printer of the present invention,white balance correcting process executed by the white balancecorrecting device inside the printer to obtain gray (R=G=B) in which red(R), green (G), and blue (B) have an equal signal level is defined as a“normal white balance correcting process”, the white balance controldevice executes the normal white balance correcting process if the whitebalance adaptation rate information cannot be obtained.

Further, the present invention is characterized in that the whitebalance control device turns off the white balance process executed bythe printer if the value of the white balance adaptation rate takenthrough the information obtaining device is smaller than a setthreshold. For example, the threshold may be set at a value indicativeof complete correction or may be varied by a user's operation.

Furthermore, another aspect of the present invention is characterized inthat the white balance adaptation rate can be represented as a numericalvalue varying from 100%, which is indicative of complete correction, to0%, which is indicative of no white balance correction, and when theamount of white balance correction executed by the white balancecorrecting device inside the printer to obtain gray (R=G=B) in which red(R), green (G), and blue (B) have an equal signal level is defined asthe “normal amount of white balance correction”, the white balancecontrol device determines the amount of white balance correctionexecuted by the printer on the basis of the following equation:the amount of white balance correction executed by the printer=thenormal amount of white balance correction×white balance adaptation rate(%)/100.

Further, according to another aspect, the printer of the presentinvention includes a “camera adaptation rate neglect mode” in which thenormal white balance correcting process is also executed if the whitebalance adaptation rate information is taken, and the camera adaptationrate neglect mode can be selected by operating a mode selecting device.

Either a “camera adaptation rate utilization mode” in which the whitebalance process is executed so as to reflect the white balanceadaptation rate set using the electronic camera or the “cameraadaptation rate neglect mode” can be selected depending on the user'soperation so that a white balance control method can be switched on thebasis of the selected mode, thereby accommodating the user's diverserequests.

An image pickup device according to a fifth aspect of the presentinvention comprises a correcting section which corrects the chromaticityor brightness of a captured image, and a storage section which storesinformation on correction of the captured image executed by thecorrecting section, in association with the captured image.

The correcting section may have an automatic correcting section thatcorrects the captured image on the basis of the amount of correctionpredetermined for the image pickup device, and the storage section maystore the amount of correction executed by the automatic correctionsection, as information on correction of the captured image.

The correcting section may have a manual correcting section thatcorrects the captured image on the basis of the user's operation, andthe storage section may store the amount of correction executed by themanual correction section, as information on correction of the capturedimage.

The correcting section may have a manual correcting section thatcorrects the captured image on the basis of the user's operation, andthe storage section may store, as information on correction of thecaptured image, information indicating whether or not the manualcorrecting section has executed correction.

The storage section may store, as information on correction of thecaptured image, information indicating to an external image processingdevice whether or not to inhibit correction of the captured image.

The correcting section may have a manual correcting section thatcorrects the captured image on the basis of the user's operation, andthe storage section may store, as information on correction of thecaptured image, information indicating to the captured image processingdevice that the captured image is to be inhibited from being corrected.

The correcting section may further comprises an automatic correctingsection which corrects the captured image on the basis of the amount ofcorrection predetermined for the image pickup device, a confirmingsection which allows the user to confirm the captured image corrected bythe automatic correcting section, and a determining section whichdetermines whether or not the user has confirmed the captured image. Ifthe determining section determines that the user has confirmed thecaptured image, the storage section may store, as information oncorrection of the captured image, information indicating to the capturedimage processing device that the captured image is to be inhibited frombeing corrected.

The image pickup device may further comprise an output section thatoutputs information on correction of the captured image and the capturedimage to an exterior in association with each other.

An image processing device according to a sixth aspect of the presentinvention comprises a displayed image generating section which generatesa displayed image on the basis of an original image, a display sectionwhich displays the displayed image generated by the displayed imagegenerating section, a correcting section which corrects the displayedimage displayed by the display section, on the basis of a user'soperation, and a storage section which stores contents of the correctionexecuted by the correcting section, in association with the originalimage.

The displayed image generating section extracts a partial area of theoriginal image to generate the displayed image. The displayed imagegenerating section generates the displayed image by enlarging thepartial area and synthesizing the original image with the enlargedpartial area. The image processing device may further comprise an outputsection that outputs the original image and the contents of thecorrection.

The image processing device may further comprise a printing section thatprints the original image corrected by the correcting section. The imageprocessing device may further comprise an image pickup section thatcaptures the original image.

An image processing device according to a seventh aspect of the presentinvention comprises a receiving section which receives an image andinformation on correction of the image, a processing section whichexecutes image processing on the image, and a control section whichcontrols the image processing executed by the processing section, on thebasis of information on correction of the image. The receiving sectionmay receive, as information on correction of the image, informationindicating whether or not the image has been corrected on the basis of auser's operation, and upon receiving information indicating that theimage has been corrected on the basis of the user's operation, thecontrol section may inhibit the processing section from executing theimage processing.

The receiving section may receive information indicative of the whitebalance adaptation rate of the image as information on correction of theimage, and if the white balance adaptation rate does not have apredetermined value, the control section may inhibit the processingsection from executing the image processing for adjusting white balance.

The above described summary of the present invention does not list allfeatures required for the present invention, but subcombinations of thisgroup of features may constitute aspects of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The nature of this invention, as well as other objects and advantagesthereof, will be explained in the following with reference to theaccompanying drawings, in which like reference characters designate thesame or similar parts throughout the figures and wherein:

FIG. 1 is a block diagram of a digital camera according to an embodimentof the present invention;

FIG. 2 is a graph showing detection frames indicative color distributionranges corresponding to light source types or the like;

FIG. 3 is a graph useful in describing a white balance adaptation rateset by a camera;

FIG. 4 is a schematic diagram of a system including a printer accordingto the embodiment of the present invention;

FIG. 5 is a flow chart showing a process procedure of a camera and aprinter system according to this example;

FIG. 6 is a diagram showing an example of a white balance adaptationrate process executed on an animated image;

FIG. 7 is a view showing an image processing system according to anembodiment of the present invention;

FIG. 8 is a schematic diagram generally showing a digital camera 110according to this embodiment;

FIG. 9 is a diagram showing an example of a configuration of functionsof an image processing unit 200;

FIGS. 10( a), 10(b) and 10(c) are views showing examples of screensdisplayed by a display section 206;

FIG. 11 is a diagram showing an example of a format of data output by anoutput section 208;

FIG. 12 is a diagram showing a configuration of functions of a printer112 according to this embodiment;

FIGS. 13( a) and 13(b) are diagrams showing examples of data formats ofdetermination tables provided in a control section 402;

FIG. 14 is a flow chart of an example of an image processing methodexecuted by the printer 112; and

FIG. 15 is a diagram showing a configuration of hardware of a personalcomputer 114 according to this embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Preferred embodiments of the present invention will be described belowin detail with reference to the accompanying drawings. The followingembodiments are not intended to restrict the claims to such aninvention, and all the combinations of the features described in theembodiments are not essential to the solution provided by the presentinvention.

First Embodiment

FIG. 1 is a block diagram of a digital camera according to an embodimentof the present invention. A taking lens 12 of a camera 10 may be asingle-focus lens or a focal-distance-variable lens such as a zoom lens.Light passing through the taking lens 12 is formed into an image on aCCD image sensor (Hereinafter referred to as a “CCD”) 16 via an infraredcut filter 13 and an optical low pass filter 14. The CCD 16 has photosensors two-dimensionally arranged on a light receiving surface thereofand primary color filters for red (R), green (G), and blue (B) arrangedin a predetermined form so as to correspond to the sensors.

An image of an object formed on the light receiving surface of the CCD16 is converted by the photo sensors into signal charges the amount ofwhich corresponds to the amount of incident light. The CCD 16 has whatis called an electronic shutter function of using shutter gate pulsetimings to control the time required by the photo sensors to accumulatecharges (shutter speed).

The signal charges accumulated in the photo sensors of the CCD 16 aresequentially read out on the basis of pulses provided by a CCD driver,not shown, to obtain voltage signals (image signals) which are dependenton the signal charges. An image signal output by the CCD 16 is subjectedto predetermined analog signal processes such as a correlated doublesampling (CDS) process and a color separation process, and is thenconverted into a digital signal by an A/D conversion section 18.

The digitalized image signal is added to a linear matrix circuit 20. Thelinear matrix circuit 20 converts the input RGB data in accordance withthe following Equation <1> to obtain new RGB data:

$\begin{matrix}{\begin{pmatrix}R^{\prime} \\G^{\prime} \\B^{\prime}\end{pmatrix} = {\begin{pmatrix}a & b & c \\d & e & f \\g & h & i\end{pmatrix}\begin{pmatrix}R \\G \\B\end{pmatrix}}} & {< 1 >}\end{matrix}$

where a to i denote constants.

The signal processed by the linear matrix circuit 20 is transmitted to awhite balance adjusting circuit (hereinafter referred to as a “WBcircuit”) 22 and a white balance gain control section 24. In thisspecification, “white balance” will be simply referred to as “WB” asrequired. The WB circuit 22 is composed of multipliers each of whichincreases and reduces the digital value of a corresponding one of theRGB color signals. Each color signal is added to the correspondingmultiplier. The multiplier for each color is provided with aninstruction for a white balance correction value (gain value) Rg, Gg, orBg by a WB gain control section 24 to adjust the level of the colorsignal in accordance with the instruction. The RGB signal subjected tothe white balance adjustment in the WB circuit 22 is transmitted to agamma conversion circuit 26. The contents of control executed by the WBgain control section 24 and the concept of a WB adaptation rate used forthis control will be described later.

The gamma conversion circuit 26 converts the input/outputcharacteristics of the white-balance-adjusted RGB signal so that thesignal has desired gamma characteristics. The gamma-converted signal istransmitted to an RGB→Y Cr Cb conversion circuit (hereinafter referredto as a “YC conversion circuit”) 28, which then converts this RGB signalinto a luminance signal Y and color difference signals Cr and Cb.

The luminance and color difference signals (Y, Cr, and Cb) obtained bythe YC conversion circuit 28 are transmitted to a Cr Cb matrix circuit30 to execute color correction on the color difference signals. Theimage data processed by the Cb Cr matrix circuit 30 is compressed into apredetermined format such as JPEG by a compression/decompression circuit32, and is then recorded on a recording medium 34 such as a memory card.At this time, information on the WB adaptation rate controlled by the WBgain control section 24 is recorded on the recording medium 34 asadditional image information. For example, the WB adaptation rate iswritten to an image file so as to be contained in tag information. Therecording medium 34 is not limited to a removable medium but may be aninternal memory of the camera 10.

Now, a white balance control method executed by the camera 10 configuredas described above will be described. An AE (Automatic Exposureadjustment) control is executed in response to a half-depressionoperation of a shutter button, not shown. With the AE control, an R, G,and B signals are taken a plurality of times using a predeterminedexposure value, and these R, G, and B signals are integrated together toobtain an integrated value. Then, on the basis of integrated value, theluminance (image-capturing EV value) of an object is determined, and onthe basis of this image-capturing EV value, an aperture value andshutter speed during image-capturing are finally determined. Then, whenthe shutter button is fully depressed, a diaphragm and an electronicshutter (charge accumulation time) are controlled in accordance with thedetermined aperture value and shutter speed.

The R, G, and B signals for one screen taken through the CCD 16 inresponse to the full depression of the shutter button are transmitted tothe WB gain control section 24 via the linear matrix circuit 20. The WBgain control section 24 divides the screen into a plurality of areas(for example, 8×8) and finds an average integrated value for each the R,G, and B signals for each divided area. The WB gain control section 24then finds the ratio R/G of the integrated value for the R signal to theintegrated value for the G signal and the ratio B/G of the integratedvalue for the B signal and the integrated value for the G signal.

The ratios R/G and B/G determined for each divided area are used todetermine which of the plurality of detection frames shown on the graphin FIG. 2 contains the divided area. The detection frames in FIG. 2including a shade detection frame, a day light color detection frame, aday white detection frame, a white detection frame, a tungsten detectionframe, and others define color distribution ranges corresponding tolight source types. On the basis of the number of areas contained in thedetection frames, the light source type is automatically determined sothat white balance adjustment is executed correspondingly to the lightsource type.

FIG. 3 shows an example of a camera WB adaptation rate used if thephotographing light source is tungsten. In this diagram, the axis ofabscissas indicates a B/G gain value, while the axis of ordinatesindicates an R/G gain value. However, in this graph, both B/G and R/Ggain values for day light are normalized to 1 (A point). In FIG. 3,correction with a “gain value equivalent to a tungsten adaptation rateof 100%” (B point), i.e. at R/G=0.5 and B/G=2.0, causes a gray objectunder a tungsten light source to be photographed in gray (R=G=B).

On the other hand, correction with a “gain value equivalent to atungsten adaptation rate of 70%” (C point), i.e. at R/G=0.65 andB/G=1.7, causes the gray object under the tungsten light source to bephotographed in reddish gray so that the atmosphere of the light sourceremains in the image.

Thus, the adaptation rate is indicative of the degree to which theatmosphere of the light source is allowed to remain in the image, and isdefined by the distance between the gain value for day light (A point)and complete correction point (B point) on the graph. The space definingthe color distributions is not limited to the (R/G, B/G) space shown inFIG. 3, but may be an LAB color space or other chromaticity diagrams.

In the case of this example, the adaptation rate is properly set between100% (complete correction) and 0% (no correction). With an adaptationrate of 100%, white balance is completely established with none of theatmosphere of the light source remaining in the image. If an adaptationrate of 0% is selected, white balance correction is not executed, withthe color of the light source output as it is. This is the same as thestate in which manual white balance is set to “day light (sunnyweather)”. As the adaptation rate approaches “0%”, more of theatmosphere of the light source remains in the image. On the other hand,as the adaptation rate approaches “100%”, less of the atmosphere of thelight source remains in the image.

The camera WB adaptation rate may be automatically determined by anautomatic white balance (AWB) function of the camera 10 or may bemanually arbitrarily set by a camera user. In this embodiment, the AWBadaptation rate can be varied depending on the photographer's taste. Inthis respect, the adaptation rate may be set step by step orconsecutively. Information on the set adaptation rate is recorded on therecording medium 34 together with the image, as additional informationin recording images.

Next, a printer will be described. FIG. 4 is a block diagram of aprinter according to an embodiment of the present invention. An imagecaptured by the camera 10 and additional information therefor aredelivered by the camera 10 to a printer 40 via a recording medium(removable medium) 34. If an image file is saved to the recording mediuminside the camera, a radio or wired data communication device is used totransmit the image and additional information therefor from the camera10 to the printer 40.

The printer 40 comprises a JPEG compressed image decompressing section42, Y Cr Cb→RGB conversion circuit (hereinafter referred to as an “RGBconversion circuit”) 44, a WB correction circuit 46, a lookup table(LUT) correction circuit 48, an RGB→YMC conversion circuit (hereinafterreferred to as a “YMC conversion circuit) 50, a print engine 52, and acontrol section 54 which control these components.

Image data read into the printer from the recording medium 34 isdecompressed by the JPEG compressed image decompressing section 42 andthen transmitted to RGB conversion circuit 44. The RGB conversioncircuit 44 converts the YC signal into an RGB signal, which is thentransmitted to the WB correction circuit 46, which then adjust the gainof each color signal. The control section 54 analyzes the imageoutputted from the JPEG compressed image decompression section 42, anddetermines a gain value for each color signal on the basis of the WBadaptation rate information, additional information for the image, toprovide gain control signal to the WB correction circuit 46.

Data processed by the WB correction circuit 46 is corrected in the LUTcorrection circuit 48, and the corrected data is then transmitted to theYMC conversion circuit 50. The YMC conversion circuit 50 converts thereceived RGB data into a yellow (Y), magenta (M), and cyan (C) colorsignals. Image data containing the converted YMC signals is transmittedto a print engine 52, which then prints image contents indicated by theimage data on a print sheet or another print medium. Thus, print matter56 with the image contents printed thereon is obtained.

The control section 54 comprises an image analyzing device, a printerauto setup function section, and a coefficient determining section. Thecontrol section 54 of the printer 40 reads WB adaptation rateinformation contained in the additional information for the image so asto execute white balance correction control reflecting the setting forthe adaptation rate. For example, a process such as the one shown in (1)to (3) is executed.

(1) Without any additional information on the WB adaptation rate, anormal AWB process is executed. The “normal AWB process”, as usedherein, refers to a process executed by the printer to correct the whitebalance of input image data in order to adjust the gain of each colorsignal so as to obtain such gray (R=G=B) as makes a red (R), green (G),and blue (B) signal levels equal.

(2) If the camera WB adaptation rate is less than 100%, the printer AWBprocess is turned off. Then, a printing operation is performed on thebasis of white balance set by the camera to avoid such correction asnegates the atmosphere of the light source. A threshold on the basis ofwhich whether or not to turn off the printer AWB process is determinedmay be fixed at “100%”, which is indicative of complete correction, ormay be varied by the user's operation. For example, if the threshold isset at 80%, control is switched so that the printer AWB process isturned off if the camera WB adaptation rate is less than 80% and isexecuted if the rate is 80% or more.

(3) The amount of AWB correction executed by the printer is calculatedusing the following Equation <2>:The amount of printer AWB correction=the normal amount of AWBcorrection×adaptation rate (%)/100  <2>

so that control can be provided such that the AWB correction executed bythe printer reflects the contents of the setting for the adaptation ratefor the camera. The “normal amount of AWB correction”, as used herein,means the amount of white balance correction achieved by the normal AWBprocess.

The printer 40 shown in FIG. 4 is preferably provided with a “cameraadaptation rate neglect mode” in which even when the printer 40 readsthe additional information on the WB adaptation rate, it does notexecute AWB control reflecting this information but the normal printerAWB process.

That is, the printer 40 has a “camera adaptation rate utilization mode”in which the WB adaptation rate information set by the camera 10 isutilized to execute AWB control, and the “camera adaptation rate neglectmode” in which no adaptation rate information is utilized. The user canproperly select either of the modes using a mode selecting device 58.The selection information from the mode selecting device 58 is input tothe control section 54, which then switches the AWB control method inaccordance with the selected mode.

FIG. 5 is a flow chart showing a process procedure executed by a systemcomprising a combination of the camera 10 and printer 40 describedabove. First, the camera 10 obtains data for light source determination(step S110; only step numbers such as S110 will hereinafter bedescribed) to determine the light source on the basis of the dataobtained (S112). Then, the camera 10 takes an adaptation rate tablecorresponding to the determined light source to determine an R/G gainand a BIG gain on the basis of the type of the light source and theadaptation rate (S116). In this respect, the WB adaptation rate may beset by the camera beforehand as in step S114 or may be arbitrarily setusing a device such as a GUI (Graphical User Interface) (S115).

Then, image data obtained in response to depression of the shutterbutton and additional information therefor (including the camera WBadaptation rate) are recorded on the recording medium 34 (S118). Afterimage-capturing, the recording medium 34 is removed from the camera 10and then installed in a medium insertion port of the printer 40. Theprinter 40 takes the image data and the additional information(including the camera WB adaptation rate) from the recording medium 34(S120). On the basis of the taken image data and additional information,the printer executes an AWB process (one of the processes describedabove in (1) to (3)) to print the target image (S122).

Now, an explanation will be given of an example in which the presentinvention is applied to a camera for recording animated images (a moviecamera).

To print one scene of an animated image having no additional informationon the WB adaptation rate, the printer carries out the normal AWBprocess. In contrast, to print one scene of an animated image havingadditional information on the WB adaptation rate, the printer executes aprocess similar to the above-described printing executed by the camera10 (electronic still camera).

In addition to a method of estimating a light source type or colortemperature and setting a WB adaptation rate on the basis of theestimated light source type or color temperature, white balanceadjustment for animated image-capturing may be achieved using the methoddescribed below. A WB gain is set so that for the entire screen or apart thereof (for example, a certain area in the middle of the screen),an RGB integrated value or an integrated value for color differencesignals indicates gray. In this case, if a WB gain value required toallow the integrated value to indicate gray is within a certain range (apredetermined range), an adaptation rate process is executed such thatthe WB gain is purposely set at a smaller value. FIG. 6 shows anexample. In this drawing, the area shown by reference numeral 62 definesa range set for an adaptation rate of 100%. The other area defines arange set for an adaptation rate of 80%.

For example, if the R and B gains required to achieve complete whitebalance are 1.1 and 0.9, respectively, they are located inside the areafor the adaptation rate of 100% shown by reference numeral 62 in FIG. 6,so that Wb control is executed with an R gain of 1.1 and a B gain of0.9.

Further, if the R and B gains required to achieve complete white balanceare 0.6 and 2.0, respectively, they are located inside the area for theadaptation rate of 80% shown by reference numeral 64 in FIG. 6, so thateach gain value is calculated by using Equations <3> and <4> so that WBcontrol is executed with an R again and a B gain that are calculated:R gain=1.0−(1.0−0.6)×0.8=0.68  <3>B gain=1.0+(2.0−1.0)×0.8=1.8  <4>

Second Embodiment

FIG. 7 shows an image processing system according to an embodiment ofthe present invention. The image processing system comprises a digitalcamera 110, a printer 112, and a personal computer 114. The digitalcamera 110, the printer 112, and the personal computer 114 transmit andreceive data to and from each other via a data transmission path. Thedata transmission path comprises, for example, wire cables such as USBsor radio channels such as Bluetooth. The data transmission path may be anetwork composed of a plurality of wire cables or radio channels, forexample, the Internet. FIG. 7 illustrates a form in which data istransmitted using such a data transmission path, but a recording mediumsuch as a removable medium may be used to transmit data between thedigital camera 110 and the printer 112 and the personal computer 114.

The digital camera 110 captures an image of an object and transmits thecaptured image data to the printer 112 or the personal computer 114. Theprinter 112 or the personal computer 114 executes a predeterminedprocess on the received image data and outputs the processed data. Thatis, the printer 112 prints and outputs the image data, and the personalcomputer 114 outputs the image data to a monitor. Further, the personalcomputer 114 transmits setting information to the digital camera 110 orthe printer 112 to change the setting information for the digital camera110 or printer 112. In this respect, the digital camera 110 is part ofthe image pickup device or image processing device according to thepresent invention, and the printer 112 and the personal computer 114 isan example of an image output device according to the present invention.

FIG. 8 shows the entire configuration of the digital camera 110according to this embodiment. The digital camera 110 comprises an imagepickup unit 120, an image pickup control unit 140, a processing unit160, a display unit 500, and an operation unit 510.

The image pickup unit 120 has mechanism members and electric members forimage forming and capturing. The image pickup unit 120 has a taking lens122, which takes and processes an image, a diaphragm 124, a shutter 126,an optical LPF (low pass filter) 128, a CCD 130, and an A/D conversionsection 132. The taking lens 122 includes a focus lens, a zoom lens, orthe like. This configuration allows an image of an object to be formedon a light receiving surface of the CCD 130, and charges are accumulatedin each sensor element of the CCD 130 depending on the quantity of lightin the object image formed (these charges will hereinafter be referredto as “accumulated charges”). The accumulated charges are read into ashift register using read gate pulses and are then sequentially read outas voltage signals using register transfer pulses.

The digital camera 110 generally comprises an electronic shutterfunction and thus does not require a mechanical shutter such as ashutter 126. To realize an electronic shutter function, the CCD 130 isprovided with a shutter drain via a shutter gate. When the shutter gateis driven, the accumulated charges are swept out into the shutter drain.Controlling the shutter gate enables the control of the time required toaccumulate charges in each sensor element, that is, the shutter speed.

The A/D conversion section 132 divides a voltage signal output by theCCD 130, i.e. an analog signal into an R, G, B color components,subjects the color components to an A/D conversion, and outputs theresulting digital image data to the processing unit 160.

The image pickup unit 120 further has a finder 134 and an electric flash136. The finder 134 may contain an LCD, and in this case, variousinformation from a main CPU 162 or the like can be displayed in thefinder 134. The electric flash 136 emits light when energy stored in acapacitor is supplied to a discharge tube 136 a.

The image pickup control unit 140 has a lens driving section 142, afocus driving section 144, a diaphragm driving section 146, a shutterdriving section 148, an image pickup system CPU 150 which controls thesesections, a range finding sensor 152, and a photometric sensor 154. Thelens driving section 142, the focus driving section 144, the diaphragmdriving section 146, and the shutter driving section 148 each have adrive device such as a stepping motor. The range finding sensor 152measures the distance to the object in response to depression of arelease switch 514, and the photometric sensor 154 measures theluminance of the object. Measured distance data (hereinafter simplyreferred to as “range finding data”) and object luminance data(hereinafter simply referred to as “photometric data”) are transmittedto the image pickup system CPU 150. On the basis of photographinginformation such as a zoom scale which is specified by the user, theimage pickup system CPU 150 controls the lens driving section 142 andthe focus driving section 144 to adjust the zoom scale and focus of thetaking lens 122.

The image pickup system CPU 150 determines an aperture value and ashutter speed on the basis of RGB digital signal integrated values forone image frame, that is, AE information. The diaphragm driving section146 and the shutter driving section 148 adjusts the aperture and opensand closes the shutter 126 on the basis of the determined aperture valueand shutter speed.

Further, the image pickup system CPU 150 controls light emission fromthe electric flash 136 on the basis of photometric data andsimultaneously adjusts the aperture. When the user instructs an image tobe captured, the CCD 130 starts accumulating charges, and after theshutter time calculated from the photometric data, outputs theaccumulated charges to the A/D conversion section 132.

The processing unit 160 has a main CPU 162 which controls the entiredigital camera 110, particularly the processing unit 160 itself, amemory control section 164 controlled by the main CPU 162, a YCprocessing section 170, an option device control section 174, acompression and decompression process section 178, and a communicationI/F section 180. The main CPU 162 transmits and receives requiredinformation to and from the image pickup system CPU 150 by serialcommunication or the like. Operation clocks for the main CPU 162 areprovided by a clock generator 188. The clock generator 188 providesclocks of different frequencies to the image pickup system CPU 150 andto the display unit 500.

A character generating section 184 and a timer 186 are annexed to themain CPU 162. The timer 186 is backed up by batteries to always countthe date and time and to provide the main CPU 162 with information onthe capturing date and time and other temporal information based on thecount value. The character generating section 184 generates textinformation such as the capturing date and time and a title, and thistext information is properly synthesized with a captured image.

The memory control section 164 controls a non-volatile memory 166 and amain memory 168. The non-volatile memory 166 is composed of an EEPROM, aflash memory, or the like to store data such as the user's settinginformation and pre-shipment adjustment values which is to be retainedeven when the power to the digital camera 110 is turned off. Thenon-volatile memory 166 may store a boot program, a system program, orthe like for the main CPU 162. The main memory 168 has a function ofacting as a frame memory which stores data output by the image pickupunit 120, a function of acting as a system memory to take variousprograms, and a function of acting as a work area. The non-volatilememory 166 and the main memory 168 transmit and receive data to and fromcomponents arranged inside and outside the processing unit 160, via amain bus 182.

The YC processing section 170 subjects YC conversion to image data togenerate a luminance signal Y and color difference (chroma) signals B-Yand R-Y. The memory control section 164 stores the luminance signal andcolor difference signals in the main memory 168. The compression anddecompression process section 178 sequentially reads out the luminancesignal and the color difference signals from the main memory 168 forcompression. The option device control section 174 writes the compresseddata to a memory card, a type of option device 176.

The processing unit 160 further has an encoder 172. The encoder 172receives the luminance signal and color difference signals as input,converts these signals into a video signal (an NTSL or PAL signal), andoutputs this video signal from a video output terminal 190. To generatea video signal from data recorded on the option device 176, this data isprovided to the compression and decompression process section 178 viathe option device control section 174. Then, the data is subjected to arequired decompression process by the compression and decompressionprocess section 178 and is then converted into a video signal by theencoder 172.

On the basis of a signal specification accepted by the option device 176and a bus specification for the main bus 182, the option device controlsection 174 generates signals required between the main bus 182 and theoption device 176 and subjects these signals to logical conversion orvoltage conversion. In addition to the memory card, the digital camera110 may support a standard I/O card conforming to, for example, thePCMCIA, as the option device 176. In this case, the option devicecontrol section 174 may include a PCMCIA bus control LSI or the like.

The communication I/F section 180 provides control such as protocolconversion in accordance with a communication specification such as USB,RS-232C, or Ethernet which is supported by the digital camera 110. Thecommunication I/F section 180 includes a driver IC as required andcommunicates with external equipment including a network, via aconnector 192. Rather than having such a standard configuration, thecommunication I/F section 180 may be constituted to transmit and receivedata to and from external equipment such as a printer, a karaokemachine, or a game machine, using a dependent I/F.

The display unit 500 has an LCD monitor 502 and an LCD panel 504. TheLCD monitor 502 is controlled by a monitor driver 506 as an LCD driver.Further, the LCD panel 504 is controlled by a panel driver 508. The LCDmonitor 502 has a size of, for example, 2 inches and is installed on therear surface of the camera to display the current image-capturing orplay mode, an image-capturing or reproduction zoom scale, the remaininglevel of the batteries, the date and time, a mode setting screen, anobject image, or the like. The LCD panel 504 is, for example, a smallblack-and-white LCD installed on the top surface of the camera to simplydisplay information such as image quality (FINE/NORMAL/BASIC or thelike), electric flash emission allowed/inhibited, the standard number ofimages that can be captured, the number of pixels, and the capacity ofthe batteries.

The operation unit 510 has mechanism and electric members required forthe user to set or specify the operation of the digital camera 110, themode of the operation, or the like. A power switch 512 determineswhether to turn on or off the power to the digital camera 110. A releaseswitch 514 has a two-stage depression structure including a halfdepression and a full depression. For example, the half depression locksan AF and AE functions, and the full depression causes an image to becaptured, so that the image is then recorded in the main memory 168, theoption device 176, or the like after being subjected to required signalprocessing, data compression, or the like. The operation unit 510 mayaccept settings made using the above switches, a rotary dial, a crosskey, and others, which are collectively referred to as a functionsetting section 516 in FIG. 8. Further, an image adjusting section 520accepts adjustment of the chromaticity or brightness of an imagedisplayed on the LCD monitor 502. The user can adjust the chromaticityor brightness of the image while viewing the image displayed on the LCDmonitor 502. The operation or function which can be specified using theoperation unit 510 includes a “file format”, “special effects”, “print”,“enter/save”, and “display switching”. A zoom switch 518 determines azoom scale.

A main operation performed using the above-described configuration willbe described below. First, the power switch 512 of the digital camera110 is turned on to supply power to each section of the camera. The mainCPU 162 takes the state of the function setting section 516 to determinewhether the digital camera 110 is in an image-capturing mode or areproduction mode.

When the camera is in the image-capturing mode, the main CPU 162monitors the half depression state of a release switch 514. When thehalf depression state is detected, the main CPU 162 obtains photometricdata and range finding data from the photometric sensor 154 and rangefinding sensor 152. On the basis of the data obtained, the image pickupcontrol unit 140 is operated to adjust the focus and aperture of thetaking lens 122 or the like. Once the adjustment is completed, thecharacters “standby” or the like are displayed on the LCD monitor 502 tonotify the user of this state. Subsequently, the main CPU 162 monitors afull depression state of the release switch 514. When the release switch514 is fully depressed, the shutter 126 is closed to sweep the chargesaccumulated in the CCD 130 out into the A/D conversion section 132.Digital image data generated as a result of a process executed by theA/D conversion section 132 is output to the main bus 182. Image dataoutput by the A/D conversion section 132 is stored in the main memory168, then processed by the YC process section 170 and the compressionand decompression process section 178, and subsequently recorded in theoption device 176 via the option device control section 174. Therecorded image is displayed on the LCD monitor 502 in a frozen state, sothat the user can view the captured image. Then, the series ofimage-capturing operations are completed.

On the other hand, if the digital camera is in the reproduction mode,the main CPU 162 reads the last captured image out from the main memory168 via the memory control section 164, and displays this image on theLCD monitor 502 of the display unit 500. In this state, when the userinstructs “forward feeding” or “reverse feeding” using the functionsetting section 516, the image captured before or after the currentlydisplayed image is read out and displayed on the LCD monitor 502. Then,the user operates the image adjusting section 520 to adjust thechromaticity or brightness of the image displayed on the LCD monitor502.

FIG. 9 shows an example of the configuration of the functions of theimage processing unit 200. The image processing unit 200 comprises astorage section 202, a displayed image generating section 204, a displaysection 206, an output section 208, and a correcting section 210. Thecorrecting section 210 has a manual correcting section 212 and anautomatic correcting section 214.

For example, the image processing unit 200 is realized by thecooperation between a program stored or taken in the non-volatile memory166 or main memory 168 and the main CPU 162. The main CPU 162 may have abuilt-in memory which may store required programs to actualize thefunctions as firmware. Although FIG. 9 shows that the functions of theimage processing unit 200 are integrated together, these functions arenot necessarily physically integrated together. For example, the mainCPU 162, the non-volatile memory 166, or the main memory 168 may havethe functions of the storage section 202. Alternatively, the displayunit 500 may have the functions of the displayed image generatingsection 204 and display section 206. Alternatively, the communicationI/F section 180, the encoder 172, or the option device control section174 may have the functions of the output section 208. In either case,the digital camera 110 may be considerably freely designed so as toactualize the functions of the image processing unit 200.

The storage section 202 stores image data received from the A/Dconversion section 132. The correcting section 210 corrects thechromaticity or brightness of an image on the basis of the image datastored in the storage section 202. Then, the storage section 202 storesinformation on image correction executed by the correcting section 210in association with the image data.

The automatic correcting section 214 corrects the image data stored inthe storage section 202, on the basis of a predetermined amount ofcorrection. For example, the automatic correcting section 214 correctsthe image on the basis of a white balance adaptation rate based on apre-shipment setting or the user's setting.

The white balance adaptation rate is a value indicative of the balancebetween the red signal R and the green signal G and the blue signal B.The white balance adaptation rate is expressed by K1 and K2 defined bythe following equations <5> and <6>:K₁=(IR/IG)  <5>;K₂=(IB/IG)  <6>;

using an integrated value IR for red signals R in a predetermined field,an integrated value IG for green signals G in the predetermined field,and an integrated value IB for blue signals B in the predeterminedfield. That is, K1 is a ratio of the integrated value IR to theintegrated value IG, and K2 is a ratio of the integrated value IB to theintegrated value IG.

The manual correcting section 212 corrects the image indicated by theimage data stored in the storage section 202, on the basis of the user'soperation of the image adjusting section 520. For example, while viewingthe image displayed on the display section 206, the user operates theimage adjusting section 520 to adjust the white balance or chromaticityof the image. Then, the manual correcting section 212 corrects the whitebalance or brightness of the image on the basis of the user's operationof the image adjusting section 520.

The storage section 202 stores the amount of correction executed by theautomatic correcting section 214, as information on correction of theimage in association with the image data. For example, the storagesection 202 stores a white balance adaptation rate as an example of theamount of correction executed by the automatic correcting section 214.The storage section 202 also stores information indicating whether ornot the manual correcting section 212 has executed correction, asinformation on correction of the image and in association with the imagedata. Alternatively, the storage section 202 may store the amount ofcorrection executed by the manual correcting section 212, as informationon correction of the image and in association with the image data.

The output section 208 associate the image data stored in the storagesection 202 with the information on correction of the image indicated bythe image data to output the resultant data to an external imageprocessing device such as the printer 112. Specifically, the outputsection 208 adds the information on correction of the image to the imagedata as tag information to output the resultant data, the information oncorrection of the image being the amount of correction executed by theautomatic correcting section 214 or the information indicating whetheror not the manual correcting section 212 has executed correction.

Alternatively, the storage section 202 may store, in association withthe image data, information indicting whether or not the printer 112, anexample of the external image processing device, is to correct theimage. For example, if the manual correcting section 212 has correctedthe image, the storage section 202 may store, as information oncorrection of the image, information indicating to the printer 112 thatthe image is inhibited from being corrected.

The storage section 202 may store image data obtained from the A/Dconversion section 132 or the image data on the image corrected by thecorrecting section 210. Then, the output section 208 may output theimage data obtained from the A/D conversion section 132 by the storagesection 202 to the printer 112 or may output the image data on the imagecorrected by the correcting section 210 to the printer 112.

Alternatively, the display section 206 as an example of a confirmingsection of the present invention may display the image corrected by theautomatic correcting section 214. Then, the manual correcting section212 as an example of a determining section of the present invention maydetermine whether or not the user has confirmed the image displayed onthe display section 206 on the basis of the user's operation. Further,if the user has confirmed the image, the storage section 202 may store,as information on correction of the image, information indicating to theprinter 112 that the image is inhibited from being corrected.Furthermore, the output section 208 may add the information indicatingto the printer 112 that the image is inhibited from being corrected,that is, information on correction of the image, to the image data astag information to output the resultant data.

The displayed image generating section 204 generates an image displayedby the display section 206, on the basis of the image indicated by theimage data stored in the storage section 202. Then, the user operatesthe image adjusting section 520 while viewing the image displayed in thedisplay section 206, to adjust the chromaticity or brightness of theimage. The manual correcting section 212 corrects the image displayed bythe display section 206, on the basis of the user's operation of theimage adjusting section 520. Then, the storage section 202 stores thecontents of the correction executed by the manual correcting section212, in association with the image data on the image displayed by thedisplay section 206.

The displayed image generating section 204 may generate an imagedisplayed by the display section 206, by extracting a partial area ofthe image indicated by the image data. Alternatively, the displayedimage generating section 204 may generate an image displayed by thedisplay section 206, by extracting and enlarging a partial area of theimage indicated by the image data and synthesizing the enlarged partialarea with the image indicated by the image data.

FIGS. 10( a), 10(b) and 10(c) are views showing examples of screensdisplayed by the display section 206. The displayed image generatingsection 204 converts an image indicated by image data selected by theuser into an image displayed by the display section 206. Then, as shownin FIG. 10( a), the display section 206 displays the displayed image.The displayed image generating section 204 may generate a displayedimage by reducing the resolution of the image indicated by the imagedata.

Further, in the displayed screen shown in FIG. 10( a), the user selectsa partial area 300 of the image. Then, the displayed image generatingsection 204 extracts and enlarges the user's selected partial area 300of the image to generate a displayed image. Then, as shown in FIG. 10(b), the display section 206 displays the displayed image generated bythe displayed image generating section 204. Then, the user can adjustthe chromaticity or brightness of the entire image while viewing theenlarged partial area 300.

Alternatively, the displayed image generating section 204 may generate adisplayed image by extracting and enlarging the user's selected partialarea of the image and synthesizing the enlarged partial area with theimage indicated by the image data. Then, as shown in FIG. 10( c), thedisplay section 206 displays the displayed image generated by thedisplayed image generating section 204. Then, the user can adjust thechromaticity or brightness of the image while viewing the enlargedpartial area 300 and the other area 302. If the chromaticity orbrightness of the partial area 300 is to be adjusted, this displayfunction of the display section 206 enables the user to adjust thechromaticity or brightness of the partial area 300 while checking achange in chromaticity or brightness of the other area 302.

FIG. 11 shows an example of a format of data output by the outputsection 208. The data output by the output section 208 has taginformation and image data. As information on correction of the image,the tag information indicates, for example, the white balance adaptationrate of the automatic correcting section 214 (AWB adaptation rate),information indicating whether or not the manual correcting section 212has executed white balance correction (manual WB correction), andinformation indicating whether or not the manual correcting section 212has corrected chromaticity (manual chromaticity correction). Further,the image data is of, for example, the JPEG format.

FIG. 12 shows the configuration of the functions of the printer 112according to this embodiment. The printer 112 comprises a receivingsection 400, a control section 402, a processing section 404, and aprinting section 406. The processing section 404 has a white balancecorrecting section 408 and a brightness correcting section 410.

The receiving section 400 receives tag information from the digitalcamera 110, the information including image data indicative of an imageand information on correction of the image. Then, the control section402 analyzes the tag information received by the receiving section 400,and on the basis of the information on correction of the image, controlsimage processing executed by the processing section 404, which processesthe image received by the receiving section 400. Then, the processingsection 404 processes the image under the control of the control section402. Then, the printing section 406 prints the image processed by theprocessing section 404.

For example, the receiving section 400 receives, as information oncorrection of the image, tag information containing informationindicating whether or not the image has been corrected on the basis ofthe user's operation. Then, if the tag information received by thereceiving section 400 indicates that the image has been corrected on thebasis of the user's operation, the control section 402 inhibits theprocessing section 404 from processing the image.

Alternatively, the receiving section 400 may receive, as information oncorrection of the image, information indicative of the white balanceadaptation rate of the image. Then, if the white balance adaptation ratehas a predetermined value, the control section 402 may inhibitadjustment of white balance carried out as image processing executed bya white balance correcting section 408 of the processing section. Forexample, if the white balance adaptation rate is not 1, the controlsection 402 may inhibit the adjustment of the white balance carried outas image processing executed by the white balance correcting section 408of the processing section. If the user captures an image of the settingsun and avoids setting the white balance adaptation rate at 1 in orderto allow the setting sun to appear reddish in the captured image, thenby inhibiting the adjustment of the white balance executed by the whitebalance correcting section 408, the printing section 406 can print animage to please the user.

FIGS. 13( a) and 13(b) are diagrams showing examples of data formats ofdetermination tables provided in the control section 402. FIG. 13( a)shows a WB correction determination table used to determine whether ornot the white balance correcting section 408 of the processing section404 is to correct the white balance of the image. The WB correctiondetermination table contains the white balance adaptation rate of theautomatic correcting section 214 (AWB adaptation rate), informationindicating whether or not the manual correcting section 212 of thedigital camera 110 has executed white balance correction (manual WBcorrection), the need for the printer 112 to correct the white balance(printer WB correction), and information indicating whether or not theprinter 112 is to correct white balance (printer WB correction).

As shown in FIG. 13( a), if the manual WB correction has been turned on,i.e. the manual correcting section 212 of the digital camera 110 hascorrected the white balance, then to give top priority to the user'sadjustment notwithstanding the fact whether or not the printer WBcorrection is required, the control section 402 inhibits the whitebalance correcting section 408 from correcting the white balance of theimage. On the other hand, if the AWB adaptation rate is not 1, then togive top priority to the adjustment executed by the digital camera 110notwithstanding the fact whether or not the printer WB correction isrequired, the control section 402 inhibits the white balance correctingsection 408 from correcting the white balance of the image.

Further, FIG. 13( b) shows a brightness correction determination tableused by the brightness correcting section 410 of the processing section404 to determine whether or not to correct the brightness of the image.The brightness correction determination table contains informationindicating whether or not the manual correction section 212 of thedigital camera 110 has corrected the brightness (manual brightnesscorrection), the need for the printer 112 to correct the brightness, andinformation indicating whether or not the printer 112 is to correct thebrightness (printer brightness correction).

As shown in FIG. 13( b), if the manual brightness correction has beenturned on, i.e. the manual correcting section 212 of the digital camera110 has corrected the brightness, then to give top priority to theuser's adjustment notwithstanding the fact whether or not the printerbrightness correction is required, the control section 402 inhibits thebrightness correcting section 410 from correcting the brightness.

FIG. 14 is a flow chart showing an example of an image processing methodexecuted by the printer 112. First, the receiving section 400 receivestag information from the digital camera, the information including imagedata indicative of an image and information on correction of the image(S200). Then, the control section 402 analyzes the tag informationreceived by the receiving section 400 to determine whether or not themanual WB correction has been turned on, i.e. the manual correctingsection 212 of the digital camera 110 has corrected the white balance(S202). If the control section determines at step S202 that the manualWB correction has been turned on, the process proceeds to step S210. Ifthe control section determines at step S202 that the manual WBcorrection has been turned off, the process proceeds to step S204.

Next, the control section 402 determines whether or not the ABWadaptation rate is different from 1, i.e. whether or not the whitebalance adaptation rate of the automatic correction section 214 of thedigital camera 110 is different from 1 (S204). If the control section402 determines at step S204 that the ABW adaptation rate is differentfrom 1, the process proceeds to step S210. If the control section 402determines at step S204 that the ABW adaptation rate is not differentfrom 1, the process proceeds to step S206.

Then, the control section 402 determines whether or not the printer WBcorrection is required, on the basis of the image indicated by the imagedata received by the receiving section 400, i.e. whether or not theprinter 112 must correct the white balance (S206). If the controlsection 402 determines at step S206 that the printer WB correction isnot required, the process proceeds to step S210. If the control section402 determines at step S206 that the printer WB correction is required,the white balance correcting section 408 of the processing section 404corrects the white balance of the image indicated by the image datareceived by the receiving section 400 (S208).

Next, the control section 402 determine whether or not the manualbrightness correction has been turned on, i.e. the manual correctingsection 212 of the digital camera 110 has corrected the brightness(S210). If the control section determines at step S210 that the manualbrightness correction has been turned on, the process proceeds to stepS216. If the control section determines at step S210 that the manualbrightness correction has been turned off, the process proceeds to stepS212.

Then, the control section 402 determines whether or not the printerbrightness correction is required, on the basis of the image indicatedby the image data received by the receiving section 400, i.e. whether ornot the printer 112 must correct the brightness (S212). If the controlsection 402 determines at step S212 that the printer brightnesscorrection is not required, the process proceeds to step S216. If thecontrol section 402 determines at step S212 that the printer brightnesscorrection is required, the brightness correcting section 410 of theprocessing section 404 corrects the brightness of the image indicated bythe image data received by the receiving section 400 (S214).

Next, the printing section 406 prints the processed image (S216). Then,the flow chart of the image processing method executed by the printer112 according to this example is completed.

FIG. 15 shows the hardware configuration of the personal computer 114according to this embodiment. The personal computer 114 comprises a CPU700, a ROM 702, a RAM 704, a communication interface 706, a hard diskdrive 708, a database interface 710, a floppy disk drive 712, and aCD-ROM drive 714. The CPU 700 operates on the basis of programs storedin the ROM 702 and RAM 704 to control each section. The communicationinterface 706 communicates with the digital camera 110 and the printer112. The database interface 710 writes data to a database and updatesthe contents of the database.

The floppy disk drive 712 reads data or a program from a floppy disk 720to provide the read data or program to the communication interface 706.The CD-ROM drive 714 reads data or a program from a CD-ROM 722 toprovide the read data or program to the communication interface 706. Thecommunication interface 706 transmits the data or program provided bythe floppy disk drive 712 or CD-ROM drive 714, to the digital camera 110or the printer 112. The database interface 710 is connected to variousdatabases 724 in order to transmit and receive data thereto andtherefrom.

The program provided to the printer 112 is provided by the user in arecording medium such as the floppy disk 720 or CD-ROM 722. The programstored in the recording medium may be compressed or may not becompressed. The program is read out from the recording medium, installedin the digital camera 110 or printer 112 via the communication interface706, and executed in the digital camera 110 or printer 112.

The program provided in the recording medium and installed in thedigital camera 110 has a storing module, a display image generatingmodule, a display module, a correction module, a manual correctionmodule, an auto correction module and an output module as functionalcomponents. Operations which each module allows the digital camera 110are the same as the operations of the corresponding members of thedigital camera 110 described in FIGS. 8 to 11, and thus the descriptionof these operations is omitted.

The program provided in the recording medium and installed in theprinter 112 has a receiving module, a control module, a processingmodule, and a printing module as functional components. Operations whicheach module allows the printer 112 to perform are the same as theoperations of the corresponding members of the printer 112 described inFIGS. 12 to 14, and thus the description of these operations is omitted.

The floppy disk 720 or CD-ROM 722, shown in FIG. 15 as an example of arecording medium, can store a part of the operation of or all thefunctions of the digital camera 110 or printer 112 according to theembodiments described in the application.

These programs may be read out directly from the recording medium by thedigital camera 110 or printer 112 for execution or may be installed inthe digital camera 110 or printer 112 before execution therein.Furthermore, these programs may be stored in a single recording mediumor a plurality of recording media. Alternatively, they may be stored ina coded form.

In addition to a floppy disk or a CD-ROM, the recording medium includesan optical recording medium such as a DVD or a PD, a photomagneticrecording medium such as an MD, a tape medium, a magnetic recordingmedium, or a semiconductor memory such as an IC card or a miniaturecard. Alternatively, a storage device such as a hard disk or RAMinstalled in a server system connected to an exclusive communicationnetwork or the Internet may be used as a recording medium to provideprograms to the digital camera 110 or the printer 112 via acommunication network. Such a recording medium is used only tomanufacture the digital camera 110 or the printer 112, and theprofit-making manufacture, sale, or the like of such a recording mediumclearly infringes on the patent right based on this application.

The digital camera 110 according to this embodiment outputs informationon correction of an image executed by the digital camera 110, as taginformation and in association with the image, thereby enabling thecontrol of whether or not the printer 112 is to correct the image.Further, the printer 112 according to this embodiment can analyze thetag information received from the digital camera 110 to correct theimage on the basis of information on correction of the image executed bythe digital camera 110.

Consequently, the digital camera 110 and printer 112 according to thisembodiment can provide such control that the printer 112 does not carryout the user's unintended correction on an image the chromaticity orbrightness of which has been corrected by the digital camera 110 on thebasis of the user's operation, thereby enabling an image to be printedto please the user.

The present invention has been described in conjunction with theembodiments, but the technical scope thereof is not limited to thatdescribed in the above-described embodiments. Various changes orimprovements may be made to the above-described embodiments. It isapparent from the description in the claims that such changed orimproved forms are also within the technical scope of the presentinvention.

As described above, according to the present invention, white balanceadaptation rate information set by an electronic camera is recorded on arecording medium together with an image so that during printing, aprinter takes the adaptation rate information to control white balancein accordance with settings for the camera. This avoids executing suchcorrection as negates the atmosphere (tint) of a light source in arecorded image in which the photographer has purposefully allowed theatmosphere to remain.

Further, the present invention provides an image pickup device whichoutputs an image in association with information on correction of theimage in order to control the correction of the image in an outer imageprocessor.

It should be understood, however, that there is no intention to limitthe invention to the specific forms disclosed, but on the contrary, theinvention is to cover all modifications, alternate constructions andequivalents falling within the spirit and scope of the invention asexpressed in the appended claims.

1. An image processing device, comprising: a receiving section whichreceives an image and information on correction of the image; aprocessing section which executes image processing on the image; and acontrol section which controls the image processing executed by theprocessing section, on the basis of information on correction of theimage; wherein the receiving section receives, as information oncorrection of the image, information indicating whether or not the imagehas been corrected on the basis of a user's operation, and uponreceiving information indicating that the image has been corrected onthe basis of the user's operation, the control section inhibits theprocessing section from executing the image processing, wherein: thereceiving section receives information indicative of the white balanceadaptation rate of the image as information on correction of the image;and if the white balance adaptation rate does not have a predeterminedvalue, the control section inhibits the processing section fromexecuting the image processing for adjusting white balance.
 2. The imageprocessing device according to claim 1, further comprising a printingsection which prints the image.
 3. An image processing method,comprising: a receiving step of receiving an image and information oncorrection of the image; a processing step of executing image processingon the image; and a control step of controlling the image processingexecuted at the processing step, on the basis of information oncorrection of the image, wherein in the receiving step, as theinformation on correction of the image, information indicating whetheror not the image has been corrected on the basis of a user's operation,and upon receiving information indicating that the image has beencorrected on the basis of the user's operation, control is made in thecontrol step so that executing the image processing in the processingstep is prohibited, wherein: in the receiving step, informationindicative of the white balance adaptation rate of the image is receivedas the information on correction of the image; and in the control step,if the white balance adaptation rate does not have a predeterminedvalue, control is made in the control step so that executing the imageprocessing for adjusting white balance in the processing step isprohibited.
 4. An image pickup device, comprising: an image takingsection which takes an image of a subject; a white balance adaptationrate setting section which sets a white balance adaptation rate for thetaken image according to input by a user; an image correcting sectionwhich corrects the taken image based on the set white balance adaptationrate; and a recording section which records information indicative ofthe set white balance adaptation rate and the corrected image so thatthe image is inhibited from being subjected to the image processing inan image processing device for adjusting white balance if the recordedwhite balance adaptation rate does not have a predetermined value.
 5. Animage pickup method, comprising: taking an image of a subject; setting awhite balance adaptation rate for the taken image according to input bya user; correcting the taken image based on the set white balanceadaptation rate; and recording information indicative of the set whitebalance adaptation rate and the corrected image so that the image isinhibited from being subjected to the image processing in an imageprocessing device for adjusting white balance if the recorded whitebalance adaptation rate does not have a predetermined value.
 6. An imageprocessing system comprising: the image pickup device according to claim4; and the image processing device according to claim 1.